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{7,"<B>,""</B>,""<I>,""</I>,""<TABLE>"} 



procedure pcwrapHLRT (page P) 
scan to the line 7 in P 

while the next occurrence of // in P occurs before the next occurrence of t 

scan in P to next occurrence of /,; save position as start of item attribute 
scan in P to next occurrence of n, save position as end of item attribute 
scan in P to next occurrence of /p; save position as start of price attribute 
scan in P to next occurrence of rp\ save position as end of price attribute 
return extracted , (item, price), } pairs 



FIGURE 1 

(PRIOR ART) 
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The URL to submit search data 
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The domain used to learn the vendor description 
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The end of header position of vendor's product pages. 
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The start of footer position of vendor's product pages. 
Same as Head element, with this element the product 
information extraction time for Shopper Agent is 
shorten. 


Left Delimiter of Item 


The Shopper Agent uses this two delimiters to identify 
a product 
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a product's price information 
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EXAMPLE 


Element 
Name 


Element Description 


Vendor Name 


800.com 


Vendor URL 


http://www.800.com 


Form URL 


http://www.800.com/search/srchrslts.asp?qs=1&slteentry=AII&entry= 


Learning 
Domain 


Md 


Head 


1230 


Tail 


</BODY> 


Left Delimiter 
of Item 


/td width="12"> 


Right 
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Item 


</fon 


Left Delimiter 
of Price 


Your Price: $ 


Right 

Delimiter of 
Price 


</b> 
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MD PRICE 



Model 
Number 


PRICE 
(US$) 


HM381MD 


399.95 


MD2070 


599.95 


MD203 


249.95 


MDR3 


399.95 



<HTML> 

<TITLE><B>A Simple Product Catalogs</B></TITLE> 
<BODY> 

<H2> MD Price </H2> 
<TABLE BORDER=1> 

<TR BGCOLOR=ORANGE><TH> Model Number </TH> 
<TH> PRICE(US$)</TH></TR> 

<TR><TD><B> HM381 MD</B></TD><TD><l>399.95</l><n"D></TR> 
<TR><TD><B> MD2070</B></TD><TD><l>599.95</l></TD><ArR> 
<TR><TD><B> MD203</B></TD><TD><I>249.95</I></TD></TR> 
<TR><TD><B> MDR3</B></TD><TD><I>399.95</I></TD></TR> 
</TABLE> 
<P> 

<HR WIDTH=200 ALIGN=LEFT> 

<P> 

<B> End Of The Product Catalog </B> 

</BODY> 

</HTML> 



FIGURE 7 



Product Entry 


Labels 


{ HM381MD. 399.95} 


{«174. 180>, <197. 202»} 


{ MD2070. 599.95} 


{«229, 234>, <251 , 256»} 


{ MD203, 249.95} 


{«283, 287>, <304, 309»} 


{ MDR3, 399.95} 


{«336, 339>, <356. 361 »} 
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* * * 


* * * 
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procedure execHLRT (wrapper (h. h, n, Ip, rp, t), page P) 
m ^ 0 

scan in P to line h 

while the next occurrence of /, in P occurs before the next occurrence of t 
m <- m + ^ 

scan in Pto the next occurrence of /, in P; save position as bm.i 
scan in P the next occurrence of n ; save position as emj 
scan in P to the next occurrence of /p in P; save position as bm,p 
scan in P to next occurrence of r^; save position as em,p 
return label {. . «hmu emi>><bmp, emp»} 

FIGURE 25 



Procedure learnHLRT (examples b) 

1 . Generate the candidate sets CandSr(l, e), Canclsi(l, e ), CandSr(p, c), Candsi(p, 
G). 

2. Enumerate the cross product of these candidate sets; each element W = (h, Ij, n, 
Ip, Tp, t), of this cross product is a wrapper. Halt if W is satisfactory i.e., execLR(W. 
Pn) = Ln, for every (Pn, Ln) e e. 



FIGURE 26 



Non-Provisional Application for Online Intelligent 
Multilingual Comparison-Ship Agents for ... 
Express Mail Label No. EV330728263US 
Attorney Docket No.: 2102680-991 100 
Gray Gary et al. - GTS/415-836-2500 
Applicant(s): Victor Hsieh Sheet 25 of 59 



/* 

* The main problem 
*/ 

procedure learnHLRT (examples e) for each 1 <k <K 
for each u e candSi(p, e): if valid|(u. p, e) then Ip^ u and terminate this loop 
for each u e candsr(i, e): if validr(u, i. s) then n^-and terminate this loop 
for each u g candSr(p, s): if validr(u, p, s) then rp<-u and terminate this loop 
for each U\\ g candsi(i, s) 
for each Uh e candSh(e) 
for each Ut e candSt(E) 

if validi.h.t( uii, Uh, Ut, e) then 

li<-Uii, h4-Uh, t<-Ut, and terminate these three loops 
return HLRT wrapper (h, \\, n. Ip, rp, t) 

r 

*Generate a set of candidates for left delimiter of price attribute 

*/ 

procedure candS|(attribute price, examples e) 

return the set of all suffixes of the shortest string in neighborS|(price, e) 

/* 

*Generate a set of candidates for right delimiter of attribute a. Here a could be item or price 

*/ 

procedure candSr(attribute a, examples e) 

return the set of all prefixes of the shortest string in neighborSr(a, e) 

/* 

* Generate a set of candidates for a page's head 
7 

procedure candSh (examples e) 

return the set of all substrings of the shortest string in heads(£) 

/* 

*Generate a set of candidates for a page's tail 
*/ 

procedure candst(example e) 

return the set of all substrings of the shortest string in tails(E) 

/* 

*Determine whether a particular candidate for the left delimiter of price is valid 
*This procedure applies constraints C3 

*/ 

procedure valid|(candidate u, attribute price, examples e) 
for each S€ neighborsi (price, s): if u is not a proper suffix of s then return FALSE 

Figure 27 A 
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for each s g tails(8): If u is a sub string of s then return FALSE 
return TRUE 

/* 

*Determine whether a particular candidate for the right delimiter of item or price is 
*valid 

*This procedure applies constraints C1 and C2 

*/ 

procedure validr(candidate u, attribute a, examples e) 
for each s g attribs(a, e): if u is a sub string of s then return FALSE 
for each s e neighbors(a, e): if u is not a prefix of s then return FALSE 

return TRUE 

/* 

*Determine whether a particular combination of candidate uh, ut. and uli for h, t, and 
*li respectively are satisfactory. 

*/ 

procedure validii.h.t(candidates Un, Uh, Ut, example e) 
for each s e heads(e) 

if is not a sub string of s then return FALSE 
if Un is not a proper suffix of scan (s, Uh) then return FALSE 
if Ut occurs before U1i in scan (s, Uh), then return FALSE 
for each s g tails (e) 
if Ut 1 S not a sub string of s then return FALSE 
if Uli occurs before Ut in s then return FALSE 
for each s g seps(s) 

if Uli is not a proper suffix of s then return FALSE 
if Ut occurs before Uli in s then return FALSE 
return TRUE 

/* 

*Return a set of containing all values of a attribute, either item(i) or price(p) in each 
*example 
*/. 

procedure attribs(attribute a, examples e) 

return U(Pn.Ln) e 8(Pn[bm ,ai ©m, al K. . .. (bm.k. em.k), . . . > € Lo} 

/* 

*Return all strings to the left of an attribute, whether these strings are in the heads 
* or the bodies of the pages 
*/ 

procedure neighborsi(attribute a, examples e) 

if a=i then return seps (i, s) U heads (e) else return seps (a, s) 
r 

FIGURE 27B 
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Call SQLAccEnv 
to allocate environment workspace 
(provides HENV handle) 






Call SQLAIIocConnect 
to allocate connection workspace 
(provides HDBC handle) 






Call SQLConnect 
to connect to the database 


i 




Call SQLAIIocStmt 
to allocate a statement workspace 
(provides HSTMT handle) 


j ► 






Call ODBC member functions 
(SQLExecDirect, SQLFetch. SQLGoData) 
to perform a database operation 






Call SQLFreeStmt 
to deallocate statement workspace 
(invalidates HSTMT handle) 


■ * 




Call SQLDisconnect 
to disconnect to the database 






Call SQLFreeConnect 
to deallocate connection workspace 
(invalidates HDBC handle) 






Call SQLFreeEnv 
to deallocate environment workspace 
(invalidates HENV handle) 



STOP 
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Create CInternetSession objects 
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Call member function 
s.GetHttpConnection 
(creates CHttpConnectlon object c) 
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Call member function 
c.OpenRequest 
(creates CHttpFile objectf) 
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Call member function 
f.SendRequest 
(sends the POST request and formdata) 
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Call member function 
f.Read 

(returns chunk of response) 



Zero bytes 
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STOP 
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rtelirnitsis 

Candideiies 




4522 



No 



Pstse Product Left 
DeHTmtexs 
Cs 
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Data Field 


Description 


Allowed Value 


Country ID 


Distinct Country Name 


Any 


Country Name 


Display Name of the Country. 


Any 


Encoding 


Display MIME type of the Web 
sites in this country. 


Valid MIME Type, A pull- 
down list of MIME Type is 
nrovided for selection 
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listOfCoimtiics 



^^^^^ ^^^^^ ' ^ ^'^h^^.t^c rnn 




Country Nanie 


Encodbng 


^Action 


ATW 


Tan^ 


Big5 




Norway 


Norway 


8859_1 


f Delete. | 


Bradi 


Brazil 


8859_1 


{:deleter| 


Belgium 


Belgium 


8859_1 




Poland 


Poland 


UTF8 


^'Delete: 


± m 


Hong Kong SAR 


Big5 


; beletf 


United Arab Emirates 


United Arab &3iifates 


8859_1 


Delete 1 


UK 


United Kiagdom 


8859^1 


Delete! 


cn US 


United Stetes 


8859_1 


; Delete 1 


Indifl 


India 


8859,1 


i'Delete:] 


Tha^and 


IHaibod 


8859^1 


; belSteJ 






00^0 I 
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Countriei > Edit Coimtiy Infoimadon 









Couobyn) 


23i_HK 


CounlxyNaine 


|Hong Kong SAR ( | - Ewslhg Countries - ) 


Encoding 


|Big5 g 






^^"ssrre Z Cancer 
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Edit CoMtiY Momati 




Country H) 




CounliyName 


( -Existing Countries -jj) 


Encoding 


ISOBB59J iJ 




^ ^ Ar#^.-li^^^ Save 1 Cancel 
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Data Field 


DescriDtion 


Allowed Value 


Vendor ID 


Distinct Vendor ID 


System generated 


Vendor Name 


Display Name of the Vendor. 


Any 


Description 


Vendor Description 


Any 


URL 


Vendor URL 


Valid URL 


Form URL 


Vendor Form URL 


Valid URL 


Country 


Country where the vendor sell the 
products 


A pull-down list of country is 
provided for selection 


Currency 


Currency which the vendor used for 
the price of the products 


A pull-down list of currency is 
provided for selection 


FIGURE 51 



List Of Vendors 





Vendor 


^ V endor Name' 


"i ^ Descnption 


^^^^ ^ ^^^^^^ ^^^^^^ 




^gwrency- 






Norway shop 


hnp'JN/ww. clgjganten.no/ 


Norway 






Quelle 


Gemiany shop 


http^/www. quelle, dc/ 


Gennany 


€ 


57 


OTTO 


Germany $hop 


http //www.ncu. otto.dc 


Gennanv 


EUR 


56 


Trend Machine 


Gennanyshop 


http://store. europe.yahoo. com^endmachine^dex-html 


German? 


EUR 


55 


Media ^ild 


Italy shop 


http://storc. euf ope.yahoo.comfaicdiawor!d/3ndcx.htinl 


Ml 


€ 


54 


Piazzaerbe 


Italy shop 


httpy/store.eufope.yahoo.com^piazzaerbc/ 


I^ 


€ 


53 


Akosto 


Itaty shop 


http://www. aicosto.it 


Italy 


€ 


51 


Vistck 


Canadian shop 


httpi/www.vistekca 


Canada 


S 


50 


HBCOnime 


Cana<£an shop 


httpy/www.hbccom/ 


Canada 


S 


49 


Red dots 


One of Ihe largest aution site in HK 


httpi/Zwww.red-dots.coni/ 


HoDfi 

KoagSAR 


HKS 


41 


HK Yahoo Auction 


One of die largest aulion site in HK 


http'i/hk. auctions.yahoo.com/ 


Hong 

KoasSAR 


HKS 


47 


GotoHK 


One of the larsest aution site in HK 


http://www.go2hk.com 


Hong 


HKS 



1 
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VenJor 

iL' 








pcSy- 




JJ 






iiupjjWww.DCSipuyvHgtuti com 




uss 


36 


BraQd$mali.com 




hapy/www.brandsmalLcom 


United States 


us$ 


18 


buydig.com 




ht^i/Avww.bti^dig com 


United States 


uss 


I? 


clubmac.com 




bt^>'y/»ww.c]ubmac.com/clubmac/ 


United States 


uss 


37 




Coiq3\ilcr & Etectromcs Wholesale Superstore 


httpJftvwwxompuvisor.com/ 


United States 


uss 




20 


(irect.mwavc.coTB 




ht^y/direct.mwave. com 


United States 


uss 


10009 


eBay 




htQ>y/www. ebay. com 


United States 




38 


Moitliae 


Compadflash, Smartmedia card, DVD-R, 
CD-jk,M jet cartridges 


www.MerijlJine.com 


United States 


uss 




12 


msncom 




ht^y/eshop.msn. com 


Urated States 


$ 


21 


pcrush-com^ 




htt}>//www.pcrush.com,' 


United States 


uss 


32 


Shop4tecli.net 


cheap CD-Ps DVD-K Compact Hash, 
Computer Desk, ink cartridges 


Shop4tech.iiel 


United States 


uss 




33 


Tck Gallery 




h%7/www.tekgaSery. com/ 


United States 


s 


40 


Vio Software 


Best Price on Microsoft, Adobe. Cord, 
Symantec Software. 


http//www.viosoftware com 


United States 


uss 




M 


Wataiart 




ht^y/www. waJmart. com/ 


United States 


uss 



J 
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Vttidor > Voidor DetaOs 





VeajdorlD 


10009 


Ven<Jor Name 


eBay 


Dcscr^tion 


|l 

_ _ _ j|j 


m 


httpy/www. ebay. com 


FormUKL 


httpy/jcarcK cbay. com^scarch/search. d[a?MfcISAPICon3maD<i=<3ctRcsuk&hl==l &SoftProper^MctaEndSort&quMy= 


Country 


Biases 


Currency 









■^^^ * 












Acnon 


10019 


Tablet PC 


Cornf^aq Tablet PC TCIOOO 


$1,699.00 


; Delete 


10020 


Tablet PC 


ADR Flitc Guide 3000 Fu^ Tablet PC 


$987.60 









Head 




Tail 




Item Left Defejrter 


<a hrc^*http//cgL ebay. com/w&'eBaylS API dD?ViewItem&category= 


Bern Fjght Defciiter 




Price Left Delimiter 


<td nowr^ aligpF=ii8ht valignF=top wid&=l ??'o>«font siz 


Price Bight Delimiter 


<BR> 
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Vmdors > £dk Vendor Infoimadon 





Vendor m 


10009 


Vendor Name 




Dcscnptlon 


iJ 

„ J 


Vendor URL 


|http:/Aww.eb3y.com 


FormURL 


|http://s8arehebay.cofn/seafclvse8rch.dHMciSAPICommand=^^ 


Cowitry 


|unKed States jl 


Currency 


1$ >J 
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COOLSAAdministration.Console \ . ^ 



Couiitiv l ^endoirj 



Vciidors > Edit Vendor M ormadon 





Vendor H) 




Vendor Name 




Description 


i 


Vendor UKL 




FormHE 




Countiy 


[Africa 1| 


Currency 


n 
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Edit Training Example 







Example ID 




Search Word 




Product Name 




Price 


1 _ 
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gOOLSA Adminisifaljon C6nsolk4^ 



Vendor Detail > Edit Voidor Desa^tion 





Vendor Name 


eBay 


Item Left 
DeHinirer 


<a href"'*http://cgi.ebay.coiii/M/eBayISAPI.dll?VievIteiiHcategory» ^ 

i 


ItemBis^ 
Delimjtcr 


</a></fo ill 

„ _ i 


Price Left 
DeHmiier 


<td nowap aUgn«right valign^top sidth^U^xfont siz ^ 

i 


Price Kigjit 
DcWcr 


<BR>| M 

M 
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^ VSm xi|: 




FIGURE 60A 



FIGURE GOB 





FIGURE 61A 



FIGURE 61 B 
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FIGURE 61C FIGURE 61D 




FIGURE 61 E 



FIGURE 61 F 
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j^X^^ r:h\ ^%t|rx 



install 



Menu 



FIGURE 64A 



FIGURE 64B 



Enterva i website^ : 
to Install From:\,; 




T.iiil 

ll/ Menu^,' 


2 AboutV-- . 

3 ZBffiSHIi' 

4 Info 1 
5;= Remove- ; 
sVupdate ' ^ ' 

^- ' , 

Install,.^'*' Menu 






Back ' . 



FIGURE 64C 



^ .iill abc . ^ ^> 

Enter a website 
to Install From: ^ 



^rttp:W27.0!ffl:80 
80Anidlets,html^' 



Go 



Select one to 
install: 



Games .jad 



Calcjad^'* >^ 
Browserjad*^ x>; >< 



Back " " Install 



FIGURE 64D 



FIGURE 64E 



^flamlScreen;- 



•_„^;TilePuzzte^ . 

^-'^J^PushPuzzle 

!n^Jfi;;^^i^|S^ 



FIGURE 64F 



T.tiii^ ^ . m> 
iA/arnihg ^ ' 

The same Version 
of Games .jad is 
already installed 011= 
tfiislSevice Do^you 
warrt to update the 

Capc'el V, OK 
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earning In Progress - HicrbsoftTln^^^ 



Vendor Description 



Learning In Progress «• Please Wait 



21 % completed! 
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